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(57) ABSTRACT 

A method and apparatus providing visual feedback to a 
computer user while dragging selected text is described. As 
its first step, the processing logic creates a text object from 
the selected text once the computer user has initiated a drag. 
Simultaneously, the selected text is visually de-emphasized. 
Secondly, the processing logic snaps the text object to the 
cursor so that the text object follows the cursor without 
obscwing text at the insertion point. Finally, when the 
computer user selects the final insertion point, the selected 
text is visually zoomed from the source location to the final 
insertion point 
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METHOD AND APPARATUS FOR 
PROVroiNG VISUAL FEEDBACK DURING 
MANIPULATION OF TEXT ON A 
COMPUTER SCREEN 

This is a continuation of application Ser. No. 08/626,295, 
filed Apr, 1, 1996 U.S. Pal. No. 5,694,151, which is cont of 
Ser. No. 08/294,195, filed Aug. 22, 1994, U.S. Pal. No. 
5,561,444, which is cont of Sen No. 07/993,784, filed Jun. 
21, 1992, abandoned. 

HELD OF THE INVENTION 

The present invention pertains to a method and apparatus 
for providing user feedback in a computer system. More 
particularly, the present invention pertains to a method and 
apparatus for providing visual feedback to a computer user 
while manipulating text on a computer screen. 

BACKGROUND OF THE INVENTION 

Many computer systems include graphical user interfaces. 
Graphical user interfaces typically include a user interface 
window, more commonly referred to as a desktop window. 
While operating within the desktop window computer users 
are able to manipulate graphical objects, i.e. icons, using a 
cursor control device such as a mouse or trackball- Icons can 
be moved simply by pointing, clicking and dragging. During 
these operations the computer user receives visual feedback 
that enhances the feeling of physical control over the desk- 
top window and the icons therein. For example, selected 
icons are highlighted and, while the mouse button is held 
down, the selected icon moves with the cursor. 

Moving text within word processor files is not as easy. 
Highlighted text cannot be dragged about a document as if 
it were an icon. There is no way to "grab" the highlighted 
text. As a result, computer users do not have a feeling of 
physical control during cut, copy and paste operations. 

SUMMARY OF THE INVENTION 

The present invention provides a method and apparatus 
providing visual feedback to a computer user while dragging 
selected text. As its first step, the processing logic of the 
present invention creates a text object from the selected, 
highlighted text when the computer user initiates a drag. 
Simultaneously, the selected text is visually de-emphasized. 
Secondly, after the cursor begins to move, the processing 
logic snaps the text object to the cursor so that the text object 
follows the cursor without obscuring the insertion point. The 
computer user is then free to move about text onscreen in 
search of an insertion point. Finally, when the computer user 
selects the insertion point, the selected text is visually 
zoomed from the source location to the insertion point. As 
a result, the computer user has a feeling of physical control 
while moving selected text within a document. 

Other objects, features, and advantages of the present 
invention will be apparent from the accompanying drawings 
and the detailed description that follows. 

BRIEF DESCRIPTION OF THE RGURES 

The present invention is illustrated by way of example 
and not limitation in the figures of the accompanying 
drawings in which references indicate similar elements and 
in which: 

FIG. 1 is an illustration of a computer system. 
FIG. 2 is a flow diagram of a method of providing visual 
feedback while directly manipulating text 
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no. 3A illustrates the selection of text. 

FIG. 3B illustrates the change of cursor caused by a 
mouse down event. 

FIG. 3C illustrates the placement of the text object 
^ relative to the cursor during a drag. 

FIG. 3D illustrates the tracking of the text object during 
a drag. 

no. 3E illxistratcs the placement of the text object after 
30 a mouse up event. 

FIG. 4A illustrates a bounding rectangle at a source 
location. 

FIG. 4B illustrates a bounding rectangle at a destination 
location. 

FIG. 4C illustrates a zoom fix)m a bounding rectangle at 
a source location to a bounding rectangle at a destination 
location. 

FIG. 5 is a flow diagram of an idle loop for changing the 
shape of the cursor. 

DETAILED DESCRIPTION 

FIG. 1 illustrates a computer system 10 in which the 
present processing logic of the invention operates. Computer 

^ system 10 is illustrated as an Apple Macintosh™ computer 
system, however, those of ordinary skill in the art will 
understand that alternative computer systems may be used. 
Computer system 10 includes a monitor 12 for visually 
displaying information to a computer user, a central pro- 
cessing unit (CPU), and internal memory, enclosed by 
housing 14. Keyboard 16 allows a computer user to provide 
input to the CPU. Computer system 10 also includes a cursor 
control device, such as mouse 18, or a trackball, joystick, or 
special keys capable of signaling movement in a particular 

2j direction. By moving mouse 18 the computer user is able to 
control the movement of the two or three dimensional 
movement of a visible symbol, such as cursor 20, on monitor 
12. Computer system 10 also includes a signal generation 
device for signaling active and inactive control states. The 
signal generation device may be realized using a switch or 
button 19 on or near the cursor control device. The up 
position of button 19 signals the inactive control slate while 
the down position of button 19 signals the active control 
slate. 

45 Computer system 10 includes an operating system 
capable of tracking the position of mouse 18 and cursor 20. 
The operating system also detects the stale of the signal 
generation device and reports the position of cursor 20 in 
each state of the signal generation device. These features of 

50 an operating system are well known in the art. Therefore, 
they will not be described in detail here. 

The processing logic of the present invention is stored 
within the internal memory of computer system 10, or on 
other machine readable media, and executed by the CPU. 

55 The processing logic can be separately compiled or loaded 
entity or incorporated as part of a larger word processing 
system. In either case, the processing logic of the present 
invention may be activated \ising techniques well known to 
those of ordinary skill in the art. 

60 Briefly described, the processing logic of the present 
invention provides visual feedbadc to users of computer 
system 10 during direct manipulation of text within a word 
processing application. That visual feedback includes 
de-emphasizing selected text at a source location, creating a 

65 text object resembling the selected text and "snapping*' the 
text object to the pointer such that the text object travels with 
the pointer. Once a destination location is chosen, the 
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selected lexi is visually "zoomed" from the source location 
to the destination location. 

FIG. 2 illustrates in flow diagram form the operation of 
the processing logic of the present invention. FIG. 3 illus- 
trates the effect of the processing logic upon selected text 30 
in relation to displayed text 32. 

Referring now to FIG. 2, the processing logic performs 
two major tasks: determining whether visual feedback is 
required and providing that visual feedback. In steps 50-58 
the processing logic determines whether visual feedback is 
required. The computer user indicates the desire for visual 
feedback by pressing mouse button 19 down while cursor 20 
is over selected text 30, continuing to hold down mouse 
button 19 and moving cursor 20 from its position at the time 
of the mouse down event. The processing logic generates 
visual feedback during the manipulation of selected text 30 
in steps 60-90. The processing logic generates visual feed- 
back for the computer user until after mouse button 19 is 
released; i.e., returns to the up position and the inactive state. 
Visual feedback while mouse button 19 is down includes 
generation of a text object, snapping the text object to the 
cursor, flashing the insertion caret at location under cursor 
and moving the text object with the cursor. Once the 
computer user releases mouse button 19 it returns to its up 
position, selected text 30 is visually zoomed from the source 
location to the destination location. 

The processing logic is not activated imtil after text has 
been selected from the text displayed on monitor 12. In FIG. 
3A, selected text 30, "Once upon a time," is indicated by 
reverse video, which distinguishes it from text 32 displayed 
on monitor 12. 

After text 30 has been selected, the processing logic waits 
in step 50 for a mouse down event. When the mouse down 
event occurs, the processing logic is also informed of the 
cursor position at the time of the mouse down event. Let us 
refer to this cursor position as the "mouse down position.'* 
Afterward, the processing logic advances to step 52. 

In step 52 the processing logic determines whether the 
computer user may require visual feedback to accompany 
the manipulation of selected text 30. This determination is 
made by comparing the mouse down position to the coor- 
dinates of selected text 30. The user does not require visual 
feedback for text manipulation if the computer user pressed 
mouse button 19 down while cursor 20 was not over selected 
text 30. In that case, the processing logic branches to step 54 
to handle the mouse down event in a conventional and 
appropriate manner. On the other hand, visual feedback may 
be required if the mouse down position was over selected 
text 30. The processing logic advances to step 56 to deter- 
mine if so. 

In step 56 the processing logic waits to see if the computer 
user requires visual feedback to accompany manipulation of 
selected text The computer user does not require visual 
feedback if a mouse up event occurs before cursor 20 is 
moved from the mouse down position. Accordingly, the 
processing logic branches to step 54 to handle the mouse up 
as if a mouse down event occurred at the original mouse 
down location. However, in the absence of a mouse up 
event, the processing logic branches to step 58. 

In step 58 the processing logic determines the current 
position of cursor 20. Let us refer to this position as the 
"current cursor position." If the current cursor position is 
some arbitrary distance away from the mouse down position 
the computer user has indicated a desire to move, or pick-up, 
selected text 30. In one embodiment, the current cursor 
position is chosen to be three pixels away from the mouse 
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down position to indicate a desire to manipulate selected text 
30. The distance chosen may vary according to needs of the 
computer user. The processing logic responds to movement 
of cursor 20 while mouse button 19 is still down by 
S branching to step 60. On the other band, if the cursor current 
position is still very close to the mouse down position, then 
the processing logic continues to await indication of whether 
or not visual feedback is desired by branching back up to 
step 56. 

With step 60 the processing logic begins providing visual 
feedback to the computer user by de-emphasizing selected 
text 30. Selected text 30 can be dc -emphasized in a number 
of ways that will be apparent to those skilled in the art. In 
one embodiment, de-emphasis of selected text 30 is per- 
formed using a QuickDraw™ brand graphics processing 
routine, whidi transforms the white areas surrounding the 
text to light gray and black letters of the text to medium gray. 
FIG. 3C illustrates de-emphasized selected text 30a accord- 
ing to this scheme. De-emphasis of selected text 30 
achieved, the processing logic advances to step 62. 

^ In step 62 the processing logic creates text object 34 from 
selected text 30. As used herein "text object" refers to a 
visual representation of selected text 30, which may or may 
not include all of selected text 30. Text object 34 need only 
include sufiBcicnt text to remind the computer user selected 

^ text 30 without unnecessarily obscuring much of the text 32 
displayed on monitor 12. Text object 34 may be created by 
generating a bit map of selected text 30 and limiting its size. 
Text object 34 may also be represented by a dotted outline 
of selected text 30, similar to what computer users see when 
they drag icons within the desktop window. Such a repre- 
sentation of text object 34 requires less CPU time but does 
not inform the computer user of selected text 30 which is 
being moved. 

2j Text object 34 may also be emphasized as compared to 
displayed text 32, In one embodiment, text object 34 is 
emphasized using reverse video. Other methods of empha- 
sizing text object 34 wifl be obvious to those skilled in the 
art Therefore, the manner of creating and emphasizing text 
object 34 wUl not be described in detail herein. The pro- 
cessing logic branches to step 64 after its creation of text 
object 34. 

The processing logic displays text object 34 at the source 
location during step 64. As used herein, "source location" 

45 refers to the initial location of selected text 30, Stated 
another way, "source location'* refers to the location that is 
the source of selected text 30. 

Because it is initially displayed at the source location, text 
object 34 obscures de-emphasized selected text 30 if they 

50 are both the same size. Once text object 34 is moved it no 
longer obscures selected text 30, The processing logic also 
displays insertion caret 36 near cuisor 20 in step 64. As using 
herein "insertion caret" refers to any visual representation 
that indicates to the computer user the precise location in a 

55 body of text where selected text 30 may be inserted. Accord- 
ing to common word processing conventions, insertion caret 
36 is visually represented by a thin vertical line. 

To provide further visual emphasis that the computer user 
is able to manipulate selected text 30, cursor 20 may be 

60 displayed as an arrow. Processing logic for doing so will be 
desCTibed in detail herein below. When ctirsor 20 is dis- 
played as an arrow, insertion caret 36 is preferably displayed 
near lip 20fl of cursor 20, as shown in FIGS. 3C and 3E. 
Initial display of insertion caret 36 and text object 34 begun, 

65 the processing logic proceeds to step 66. 

The processing logic begins the process of snapping text 
object 34 to cursor 20 in step 66. The processing logic does 
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this by initializing an interpolation factor, which is used to In step 80 the processing logic determines whether the 

snap text object 34 to cursor 20 in a discrete and finite computer iiser has selected an insertion point, or destination 

number of steps. Text object 34 is gradually moved to cursor location, for selected text 30. (As used herein "destination 

20 to prevent computer users from becoming disoriented by location" refers to the position of cursor 20 at the time of a 

text object 34 appearing in an unfamiliar location. This done, 5 mouse up event.) The processing logic makes this determi- 

the processing logic enters the snapping and tracking logic nation by discovering whether a mouse up event has 

by branching to step 68. occurred. A mouse up event necessarily accompanies selec- 

The loop of steps 68-90 snaps text object 34 to cursor 20 ^qj, Qf ^ destination location or insertion point. The location 

and, once snapped, ensures that text object follows the of cursor 20 at the time of the mouse up event determines the 

movement of cursor 20 on monitor 12. The first step within insertion point for selected text 30. The processing logic 

the loop is determining whether the mterpolalion factor has responds to a mouse up event by branching to step 82. 

readied its maximum value of one. If it has not, text object Conversely, the absence of a mouse up event indicates that 

34 has not yet snapped to cursor 20. To continue aiappmg, computer user has not yet selected the destination 

the processing logic branches to step 70. On the other hand, location. The processing logic responds to this state of 

if text object 34 has snapped to cursor 20, as indicated by the branching back to the start of the tracking and 

maximum value of the interpolation factor, the proccssmg snapping loop, step 68. 

logic advances to step 72. * r l * . * <m 

°^ . ^ ' If.- , J After the mouse up event, with step 82 the processing 

Dunng step 70 the mleqK.lation factor is mcrenaenled^ >^ .^^ 

The amount by which the interpolation factor is incremented ^^^^ ^ movement of selected text 30 from the source 

depends upon the choice of the number of steps for tex ^ {^^^^^^ destinadon location. This involves three 

object 34 to reach cui^or 20^ For example, if the n™ber of processing logic calculates bounding lect- 

stepschosen for textobject 34 to reach ^^or 20is four, then ^^^^ forilected text 30 at both the source location and the 

the interpolation factor is incremented by 0-25 earf. pass ^^^^^^^^ g^^^j processing logic zooms 

through step 70 Tht number of steps chosen will depend ^^^^ ^^^^^^ ^ 

upon the visual effect and re^onse Ume desired. After ^ ^^^^^ boxindiag rectangle at the destination location, 

incrementing the mlerpolaUon factor, the processmg logic ^ selected text 30 is displayed at the destination 

branches to step 72. location in the third and final step. 

The processing logic moves text object 34 in step 72 to a , . o-i .u • i • . , . 

location determkied by the inteT,olation factor and the 1" ^'fP 82 processmg logic computes a bounding 

current distance between the sour^ location and cursor 20. 30 ^^'^gl^ ^0 at the source locaUon_ ms 

XT -7^ • 1.- r * u » * u^A step, and the second, are illustrated m FIG. 4 usmg selected 

Thus, if the interpolation factor has not yet reached its 3»^v> i ^ im, « n ♦ T« iaa 

* F J* J text 31- i.e.. Jack and Jill. Boundme rectangle 100 is 

maximum value, text object 34 will be moved toward cursor ^ . / ^^^^ b & fi.^u^,* 

~r , . * . * • u* 1- UK tu^ defined by two pomts of selected text 31: the pomt furthest 

20 aloDE an imagmary straight Ime between the source ^^^vvi j . , ^ * * ♦u u *« ™ -^k* tu^ 

7 . ^ B J 6 K« tK^ to the top left and the pomt furthest to the bottom nght. The 

location and cursor 20 to a locatmg determmed by the .i' y °r 

1.- 1- J u *u • . 1 *• p c#^t«ri dimensions of bounding reaangle 100 computed, the pro - 

distance multiplied by the interpolation factor. Stated 35 . , - ^ * , oa -n.^. ^uL^r. 

, ,^ . . . u- * V ..^A t« o cessme loeic proceeds to step 84. These pomts are chosen 

another way, dunng step 72 text object 34 is moved to a ^"^"^^ ^ 1 . _. . . ^- n <u 

J -JL • A «f*k- because the selected text may span vertically more than one 

location determined by a weighted average of the source ^J^^a^^^. tuv j ^ j 

location and the destination location using the interpolation 

factor. When the interpolation factor reaches its maximum In step 84, offscreen the processmg logic moves selected 

value, text object 34 snaps to cursor 20. Thereafter, text text 31 to the destination location. As understood by those 

object 34 follows the movement of cursor 20 providing a skiUed in the art, computer 10 mamtams m mternal memory 

visual impression that text object 34 is attached to cursor 20. a copy of the text file that text displayed momlor 12 is part 

This, in turn, gives the computer user a feeling of physical of. This copy is said to be "offscreen." Thus, it wiU be 

^qjj(jq2 understood that the activities of step 84 do not aher the text 

In one embodiment, text object 34 is snapped to the lower 45 displayed on monitor 12. 

left hand of cursor 20, as shown in FIGS. 3C and 3D. This In moving selected text 31 to the destination location in 

location prevents text object 34 from obscuring insertion step 84, the processing logic performs an intelUgent paste, 

caret 36 and focuses the computer user's attention on which is also commonly referred to as intelligent cut and 

insertion caret 36 and cursor 20 while maintaining the strong paste. Intelligent cut and paste is a set of editing features that 

visual impression that text object 34 is atUched to cursor 20. 50 account for the need for spaces between words. FIGS. 4A 

Those skilled in the art will appreciate that other locations and 4B illustrate how intelligent cut and paste performs. In 

near or on cursor 20 may also convey the same visual FIG. 4A, insertion caret 102 is the space immediately 

impression. following the word "the." Without intelligent cut and paste, 

After moving text object in step 72, the processing logic after inserting selected text 31 displayed text 33 would not 

advances to step 74. There the processing logic moves 55 inchide a space between "Jack" and "the" unless selected 

insertion caret 36 if cursor 20 has moved. Insertion caret 36 text 32 inchides a space before "Jack " Stated another way, 

is moved to a location between the two characters nearest to without intelligent cut and paste, after inserting selected text 

cursor 20. This done the processing logic advances to step 31 the sixth hne 104 of displayed text 33 would read as 

"assumed the jack." However, tising intelligent cut and 

During step 76 the processing logic compares the current 60 P^te, the sixth line 104 includes a space between "the" and 

location of insertion caret 36 to its previous location. If "Jack," regardless of whether selected text 31 mcludcs a 

insertion caret 36 has not moved from its previous location, space before "Jack." Thus, using intelligent cut and paste 

the processing logic advances to step 78. There insertion sixth fine 104 reads as "assumed the Jack, as illustrated m 

caret 36 is "flashed," or blinked on and off, indicating an idle FIG. 4B. 

state. On the other hand, if insertion caret 36 changed its 65 After moving selected text 31 to the destination location, 

location during step 74 then the processing logic advances to the processing logic emphasizes seleaed text 31. As a result 

step 80. when the offscreen copy of the file is finally displayed, the 
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computer users aitention will be called to selected text 31 at 
the destination location. Selected text 31 may be emphasized 
visually in a great many ways, including displaying selected 
text 31 in reverse video. 

Whether selected text 31 is also removed from the source 
location during step 78 depends upon whether the computer 
user has requested a cut and paste or a copy and paste. If a 
cut and paste operation was selected text 31 is removed from 
the source location. Otherwise, selected text 31 remains at 
the source location, but it will no longer be de-emphasi2ed. 

The processing logic proceeds to step 86 from step 84. 
Having moved selected text 31 to the destination location, 
the processing logic now computes a botmding rectangle for 
selected text 31 at the destination location, like bounding 
rectangle 100, bounding rectangle 104 is defined by two 
points of selected text 31: the point of text furthest to the top 
left and the text point furthest to the bottom right. Given 
insertion point 102, the dimensions of bounding rectangle 
104 may vary from those of bounding rectangle 100. This is 
the case in FIG. 4B. 

Preparations for zooming complete, the processing logic 
branches to step 88 from step 86. In step 88, the processing 
logic zooms from selected text 31 at the source location to 
selected text 31 at the destination location. Zooming is a 
well known visual effect that animates the movement of an 
object between two points on monitor 12. Methods for 
animating zooms are well known and will not be described 
in detail herein. The dimensions of bounding rectangles 100 
and 104 are provided to a zoom processor. Given these, the 
zoom starts with a bounding rectangle 100 displayed near 
the source location. Two or more rectangles are displayed on 
monitor 12 at a lime, each successive rectangle more closely 
approaching the dimensions and final location of bounding 
rectangle 104. FIG. 4C attempts to illustrate this idea. The 
dimensions of intervening rectangle 106 differ slightly from 
those bounding rectangle 100, just starting to approach those 
of bounding rectangle 104. Similarly, the dimensions of 
intervening rectangle 108 differ from those of intervening 
rectangle 106, approaching more closely the dimensions of 
botmding rectangle 104. The zooms ends with the display of 
bounding rectangle 104 near the destination location. 

The processing logic advances to step 90 after the zoom 
is complete. There the processing logic displays onscreen 
selected text 31 at the destination location. Following as it 45 
does the zoom, the effect of step 78 is that the zoom drops 
selected text 31 at the destination location. 

The processing logic branches to step 92 from step 90 to 
await activation again. 

Additional visual feedback may be provided to the com- 
puter user to emphasize that selected text 30 may be dragged 
within a window, or between windows. Displaying cursor 20 
as an arrow, rather than an I-beam, while cursor 20 is over 
selected text 30 emphasizes this fact. FIG. 5 illusu-ates in 
flow diagram form a method for doing so as a background 
process. 

The processing logic begins in step 110 by determining 
whether cursor 20 is over selected text 30. If cursor 20 is not, 
the processing logic branches to step 112. There cursor 20 is 
displayed as an I-beam. On the other band, if cursor 20 is 
over selected text 30, the processing logic advances to step 
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114. During this step the processing logic displays cursor 20 
as an arrow, indicating that cursor 20 is over a draggable 
item. 

Thus, a method and apparatus for providing visual feed- 
back to a computer user while manipulating text has been 
described. The visual feedback includes CTealion of a text 
object from selected text, tracking the insertion point as user 
moves mouse and zooming the selected text from its source 
location to its destination location. 

In the foregoing specification, the invention has been 
described with reference to specific exemplary embodiments 
thereof. It will, however, be evident that various modifica- 
tions and changes may be made thereto without departing 
from the broader spirit and scope of the invention as set forth 
in the appended claims. The specification and drawings are, 
accordingly, to be regarded in an illustrative rather than a 
restrictive sense. 

What is claimed is: 

1. An apparatus providing visual feedback while manipu- 
lating text, the apparatus comprising: 

a) a computer system inchiding: 

1) a central processing unit; 

2) a display device for displaying images and text, the 
display device being coupled to the central process- 
ing tmit; 

3) a control device for interactively positioning a 
visible symbol on the display device, the control 
device having a button having a first position and a 
second position, the control device being coupled to 
the central processing unit; 

b) a first process coupled to the central processing unit, 
the first process creating a text object from selected 
text; 

c) a zooming process coupled to the central processing 
unit, the zooming process causing the zooming from a 
first bounding rectangle for the selected block of text at 
the source location to a second bounding rectangle for 
the selected block of text at the destination location 
such that the movement of the first bounding rectangle 
to the size and location of the second bounding rect- 
angle at the destination location is animated. 

2. A method for providing visual feedback to a computer 
user while manipulating selected text displayed on a display 
device of a computer system, the computer system including 
a control device for interactively positioning a visible sym- 
bol on the display device, the control device having a button 
having a first position and a second position, the method 
comprising: 

a) creating a text object from the selected text when the 
button is in the second position while the visible 
symbol is over the selected text at the source location; 

b) zooming from a first botmding rectangle for the 
selected block of text at a source location to a second 
bounding rectangle for the selected block of text at the 
destination location such that the movement of the first 
bounding rectangle to the size and location of the 
second bounding rectangle at the destination location is 
animated. 
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